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1.  INTRODUCTION 


The  problem  we  consider  may  be  stated  as  follows.  Let  X  =  (Xi  :  . . .  :  Xm)  be  a  p  x  m 
data  matrix  with  the  i-th  column  X,  representing  p  measurements  made  on  the  i-th  unit 
(population  or  individual).  The  vector  X,  is  called  the  i-th  unit  profile  (UP).  The  UP’s 
can  be  represented  as  points  in  an  appropriate  p-dimensional  space  The  object  is  to 
construct  a.  k  x  m  matrix 

y  =  (Fi  :...:r^)  (1.1) 

with  k  <  p,  for  representing  the  UP’s  in  a  A;-dimensional  Euclidean  space  (Fj  €  E*'  as 
the  coordinate  vector  of  the  i-th  unit)  with  the  usual  definition  of  distance  between  points  in 
such  a  way  that  the  configuration  of  points  in  Rp  is  maintained  to  the  largest  possible  extent 
in  E*’.  To  make  the  problem  more  precise,  we  need  to  specify  the  configuration  of  points 
relevant  to  a  given  problem  and  also  a  method  of  comparing  the  configurations.  A  natural 
way  of  specifying  the  configuration  of  points  in  a  space  is  through  a  matrix  of  distances 
(or  dissimilarities)  between  points.  Let  A  =  (Sij)  be  the  m  x  m  matrix  of  dissimilarities 
between  the  points  (Xi , . . .  ,  Xm)  in  and  D  =  (dij)  be  the  corresponding  mxm  matrix 
of  Euclidean  distances  between  the  points  (Fi, . . .  ,  Ym)  in  E^.  We  have  to  determine  the 
transformation  X  — *•  F  in  such  a  way  that  A  —  D  is  close  to  the  null  matrix  or,  at  least 
dij's  bear  a  monotone  relationship  with  6ij  to  the  extent  possible.  We  consider  some  specific 
problems  associated  with  continuous  and  discrete  measurements. 

2.  CANONICAL  COORDINATES 

Let  X  be  as  defined  in  Section  1  with  X,-  as  the  column  vector  representing  the  p  mea¬ 
surements  taken  on  the  i-th  unit.  Let  be  a  vector  space  with  a  specified  inner  product 
and  the  associated  norm 


(x,j/)  =  x'My,x,xj  e  R^ 

||x||  =  (x',x)U2^a;  g /JP.  (2.1) 

where  M  is  a  positive  definite  matrix.  Then  the  configuration  of  the  m  points  Xi, . . .  ,Xm 
can  be  specified  by  the  matrix  C  =  (cij)  where 

co=(^.-0'M(X,-0  (2.2) 

^  =  (^1,...  ,^p)^  is  a  fixed  point  in  R^.  We  call  such  a  vector  sj^ace  as  Mahalanobis 
or  M-space.  Let  us  also  associate  with  Xi  a  weight  >  0  such  that  w\  -|- . . .  -f-  Wm  =  1, 
and  define  W  =  diag(ti;i , . . .  ,  Wm),  i-e.,  a  diagonal  matrix  with  the  elements  w\,. . .  ,  in 
the  diagonal.  The  corresponding  configuration  with  the  origin  as  the  reference  point  in  the 
reduced  space  E*  is  F'F  where  F  is  of  order  k  x  m  with  the  i-th  column  representing  the 
i-th  population.  We  choose  F  such  that 


r-FF'ii 


(2.3) 
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is  a  minimum  for  a  suitably  chosen  norm.  We  consider  a  (PF,  PF)-invariant  norm  satisfying 
the  condition 

\\B{C  -  YY')B\\  =  \\C  -  YY'W  VB  3  B'WB  =  B  (2.4) 

in  which  case  the  closed  form  solution  to  the  problem  is  contained  in  the  following  theorem. 

Theorem:  Consider  the  s.v.d.  (singular  value  decomposition) 

M'/2(X  -  =  AxC/iV/  +  . . .  +  Apf/pV;'  (2.5) 

with  singular  values  Aj  >  . . .  >  Ap,  where  M and  are  symmetric  square  roots  of  M 

and  W  respectively.  Then  the  choice  of 


Y  = 


/AiViW-i/2\ 


\AfcWW-»/2/ 


(2.6) 


minimizes  (2.3)  for  any  (W,  W)-invariant  norm. 

The  matrix  Y  in  (2.6)  is  of  order  k  x  m  and  the  i-th  column  gives  the  coordinates  of  the 
i-th  unit  in  the  reduced  space  E*‘.  We  call  these  coordinates  as  the  canonical  coordinates. 
We  note  that  a  further  minimization  of  (2.3)  with  respect  to  ^  leads  to  the  choice 


i  =  XWl.  (2.7) 

A  detailed  proof  of  the  above  theorem  can  be  found  in  Rao  (1964,  1979,  1980,  1985).) 

The  solution  Y  given  in  (2.6)  can  be  expressed  as  the  transformation 


Y  =  G'{X-^l')  (2.8) 

where  G  =  :  . . .  :  Uk),  which  is  of  order  p  x  k,  and  Ui  is  as  defined  in  the  s.v.d. 

(2.5).  It  is  seen  that  the  columns  of  G  are  the  first  k  eigen  vectors  of  the  variance-covariance 
matrix  between  populations 

(Jf  -  ^l')W(X  -  ei')'  (2.9) 

with  respect  to  M~F  In  fact  the  associated  eigen  values  are  the  squares  of  the  singular 
values  in  (2.5). 

The  concept  of  canonical  variates  (coordinates)  was  introduced  in  an  early  paper  by  the 
author  (Rao  (1948))  for  graphical  representation  of  taxonomical  units  characterized  by  mul¬ 
tiple  measurements.  This  was,  perhaps,  the  first  attempt  to  reduce  high  dimensional  data 
to  two  or  three  dimensions  using  an  objective  criterion  for  purposes  of  graphical  displays. 
Since  then,  graphical  representation  of  multivariate  data  for  visual  examination  of  clusters. 
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outliers  and  other  structures  in  data  has  been  an  active  field  of  research.  Some  of  the 
developments  are  biplots  (Gabriel  (1971),  Gifi  (1990),  Gower  (1993),  Greenacre  (1993a)) 
multidimensional  scaling  (Kruskal  and  Wish  (1978)),  correspondence  analysis  (Benzecri 
(1992),  Greenacre  (1984),  (1993b)),  ChernofF’s  faces  (Chernoff  (1993))  and  parallel  coor¬ 
dinates  (Mahalanobis,  Ma.zumdar  and  Rao  (1949),  Wegman  (1990)).  Cavalli-Sfroza  (1991) 
uses  canonical  coordinates  (variables)  in  interpreting  the  evolution  of  human  populations. 

3.  LOSS  OF  INFORMATION 


3.1  Deficiency  in  the  configuration  matrix 


In  terms  of  the  s.v.d.  (2.5),  the  configuration  matrix  (2.2)  of  the  profiles  is 
c  =  c,  =  w-'/2(A2vi  V,'  + . . .  + 

while  that  based  on  the  canonical  coordinates  (2.6)  in  Ek  is 

Ck  =  r'r  =  w-’/2(a2  Vjv;  .  -i-  xlVkVDw-^f^ 


eind  the  deficiency  is 


Di  =  C.  -  C.  =  W'-'/2(AU,n+,l4'+,  + . . .  + 

An  overall  measure  of  loss  of  information  is  the  ratio 


trace  A? -h  . . . -h  A2 

trace  ~  A2 

where  A^  =  Aj  4- . . .  A^.  It  is  customary  to  compute  the  ratios 

'^1  A2 
A2’  A2’"' 


(3.1) 


(3.2) 


expressed  as  percentages  to  indicate  the  relative  importance  of  the  canonical  coordinates  in 
different  dimensions. 


3.2  Deficiency  in  the  matrix  of  distances 

It  is  more  important  to  assess  the  distortions  in  the  inter  profile  squared  distances  due 
to  reduction  in  dimensionality.  The  m  x  m  matrix  of  these  squared  distances  denoted  by  S 
can  be  computed  from  the  configuration  matrix  C  by  the  formula 

5  =  cT-H1c'-2C  =  (4)  (3.3) 
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where  c  is  the  vector  of  the  diagonal  elements  of  C.  The  corresponding  matrix  in  the  reduced 
space  is 

S{k)  =  C(ik)l'  +  lc(fc)  -  2C(k) 

so  that  the  matrix 

D^=S-  S(*)  =  (3.4) 

measures  the  deficiencies  in  the  distances  due  to  reduction  of  dimensionality.  An  over  all 
measure  of  deficiency  is  the  ratio 


^  A|^., +...  +  A2 
A2  +  ...  +  A2 


which  is  the  same  as  (3.1). 

3.3  Deficiency  in  the  dispersion  matrix 

The  weighted  dispersion  matrix  between  profiles  in  the  original  space  is 

B  =  (X  -  (l')W{X  -  «!')'  =  (6o)  (3.6) 

while  the  corresponding  matrix  in  the  reduced  ^-dimensional  space  is 

B(fc)  =  M-^/\XlUrU[  H- . . .  -f-  XlUkUi)M-^/^  =  (3.7) 

The  proportion  of  the  between  profile  variance  in  the  i-th  variable  explained  by  the  first  k 
canonical  variates  (coordinates)  is 

*  =  !,•••  ^P-  (^-S) 

For  an  interpretation  of  the  canonical  coordinates  in  different  dimensions  it  would  be 
useful  to  compute  the  proportion  of  variance  in  each  variable  explained  by  each  of  the 
canonical  variates,  i.e.,  to  obtain  a  decomposition  of  (3.8)  in  terms  of  canonical  variates. 
For  this  purpose,  we  introduce  the  matrices 

£;i  :...:  Api7p)  =  (eo)  (3.9) 

^2  —  i^ij/ y/^t)  —  ifij)  (3.10) 

where  bu  is  as  defined  in  (3.6).  Let  be  the  matrix  obtained  by  retaining  only  the  first 
k  colunms  in  Ei  for  i=l,2.  Then  it  is  seen  that 

EiE[  =  5,  Ei(^k)^i(k)  —  ^(k)-  (3-11) 
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Let  us  consider  the  matrix  and  define  what  may  be  called  canonical  coordinates  for 

variables  (CCV)  in  k  dimensions  as  follows. 

Table  1.  Canonical  coordinates  for  variables 


Variable 

dim  1 

dim  2 

dimk 

1 

eii 

612 

eik 

2 

621 

622 

e2k 

P 

tpi 

^P2 

^Pk 

If  we  plot  the  variables  as  points  in  E'‘  using  the  row  coordinates  in  different  dimensions, 
then  the  scalar  products  of  the  vectors  representing  the  variables  are  the  elements  of 
the  best  fc-dimensional  approximation  to  B. 

There  is  some  advantage  in  plotting  the  variables  using  the  standardized  coordinates  (/,y) 
defined  in  (3.10)  as  shown  in  Table  2. 

Table  2.  Standardized  CCV’s  and  the  variance 
explained  by  each  canonical  variate 


Variable 

Standardized 
coordinates 
dim  1 . . .  dim  k 

Proportion  of  variance 
explained 

dim  1 . . .  dim  k  total 

1 

fll  • 

•  •  flk 

/?! 

P 

fpl  • 

•  *  fpk 

fpl 

^f"p> 

The  magnitudes  in  the  right  hand  block  of  Table  2  indicate  the  influence  of  different 
vEiriables  in  each  dimension  (canonical  variate)  in  the  reduced  space.  This  may  enable  us  to 
associate  each  dimension  with  certain  variables. 

We  may  plot  the  variables  using  the  CCV’s  in  the  same  chart  as  the  canonical  coordinates 
for  the  profiles.  It  is  seen  that  all  variable  points  lie  inside  the  unit  sphere  in  and  the 
variables  close  to  the  surface  of  the  sphere  have  greater  influence  on  the  canonical  variates. 

It  may  also  be  mentioned  that  it  is  the  usual  practice  in  a  biplot  to  represent  the  i-th 
variable  as  a  directed  line  using  the  direction  cosines  proportional  to  the  i-th  row  elements 
in  the  matrix 

£;,(fc)=M-'/2(i7,  :...:t7,)  (3.12) 

in  which  case  the  projections  of  a  profile  point  in  these  directions  are  proportional  to  the  ap¬ 
proximate  coordinates  of  the  profile  in  the  original  space  (see  Gabriel  (1971)  and  Greenacre 
(1993a)). 
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Note  S.l.  The  choices  of  M  and  W  as  inputs  in  the  analysis  for  canonical  coordinates 
need  some  discussion.  The  choice  of  M  is  related  to  the  distance  measure  between  profiles 
appropriate  in  a  given  investigation.  In  taxonomical  classification,  M  is  generally  chosen 
as  the  inverse  of  the  variance-covariance  (dispersion)  matrix  of  the  measurements  on  units 
within  taxa  leading  to  Mahalanobis  distance  (see  Mahalanobis  (1936),  Rao  (1945,  1947)). 
The  matrix  W  is  taken  to  be  diagonal  with  the  i-th  diagonal  element  Wi  proportional  to  the 
number  of  individueds  sampled  from  the  e-th  taxa  to  estimate  its  profile.  For  a  chosen  M, 
the  configuration  of  the  profiles  in  the  reduced  space  will  depend  on  W,  but  is  likely  to  be 
robust  provided  the  io,’s  are  not  widely  different.  In  the  study  reported  in  Rao  (1948),  all  the 
Wi's  were  chosen  as  equal  although  the  sample  sizes  for  different  populations  were  different. 
However,  the  choice  of  u),’s  as  proportional  to  sample  sizes  enables  us  to  test  hypotheses  on 
goodness  of  fit  of  lower  dimensional  planes  to  the  observed  profiles.  For  details,  the  reader 
is  referred  to  Rao  (1973,  pp.556-560,  1985). 

If  we  desire  that  the  configuration  of  a  subset  of  profiles  to  be  better  preserved  in  the 
reduced  space  than  the  others,  then  we  have  to  give  bigger  weights  to  those  profiles. 

Note  S.2  In  many  situations  we  have  a  data  matrix  X  giving  the  measurements  of  p 
variables  made  on  m  individuals  without  any  further  information  to  guide  us  in  the  choices 
of  the  M  and  W  matrices.  In  such  cases,  the  usual  choices  of  M  and  W  are  the  unit  matrices 
and  the  resulting  canonical  coordinate  analysis  is  the  Principal  Component  Analysis  (PCA) 
introduced  by  Hotelling.  Some  characterizations  of  the  principal  components  and  their 
applications  are  given  in  a  paper  by  Rao  (1964).  It  is  also  the  practice  to  apply  PCA  on 
CX,  i.e.,  after  a  suitable  scaling  of  the  measurements.  One  choice  of  C  is  a  diagonal  matrix 
with  the  i-th  diagonal  element  Ci  =  where  su  is  the  i-th  diagonal  element  of  the 

matrix 

(X-Xl')(X-Jtl')'. 

This  procedure  is  equivalent  to  using  the  canonical  coordinate  analysis  choosing  M  —  C 
and  W  =  I.  Another  possibility  which  has  not  been  considered  before  is  the  choice,  c,  = 
l/mj  where  m,-  is  a  mecisure  of  location  such  as  the  mean  or  median  of  the  measurements 
on  the  f-th  variable. 

Note  3.S.  A  more  general  problem  not  considered  in  this  paper  is  as  follows.  The  basic 
space  is  somewhat  general  with  a  specified  nonnegative  proximity  index  between  any  two 
points.  Given  a  set  of  points  with  the  matrix  of  proximity  indices  between  points,  the 
problem  is  to  transform  the  points  to  a  low  dimensional  Euclidean  space  such  that  the 
inequality  relationships  between  proximity  indices  are  maintained  to  the  extent  possible 
in  the  corresponding  Euclidean  distances.  Such  a  transformation  is  achieved  through  the 
algorithm  for  multidimensional  scaling  as  developed  by  Kmskal  and  Wish  (1978). 
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4.  TWO  WAY  CONTINGENCY  TABLES 


We  consider  dichotomous  categorical  data  with  s  rows  and  m  columns  and  observations 
in  the  (t,  j)-th  cell.  Define 


N  =  (n,j), n,-.  =  ^ n.j  =  ^ n  =  ^ ^ n 
i=i  1=1 


1  1 


i?  =  Diag  (ni./n,...  ,n3./n). 

C  =  Diag  (n.i/n,...  ,n.„,/n) 

/Pi|i 

Pl|m\ 

P  =  n-'iVC-^=  .  ... 

1  ,  column  profiles. 

(4.1) 

\P*|i  ••• 

Ps\m) 

Am  ••• 

9m|l  \ 

g  =  n-*p-’iV=  .  ... 

1  ,  row  profiles 

(4.2) 

\9i|s 

<Zm|s  / 

p  =  -Ri, 

g  =  Cl. 

The  problem  is  to  represent  the  column  (row)  profiles  as  points  in  E^,k  <  s,  such  that 
the  Euclide8in  distances  between  points  reflect  specified  eiffinities  between  the  corresponding 
column  (row)  profiles. 

The  technique  developed  for  this  purpose  by  Benzecri  (1992)  is  known  as  correspondence 
anzilysis  (CA)  which  can  be  identified  as  canonical  coordinate  analysis.  For  instance,  for 
representing  the  column  profiles,  we  need  to  choose 


X  =  P,  M  =  R-\  W  =  C 

and  apply  the  analysis  of  Section  1.  Thus  one  finds  the  s.v.d.  of 

i?-i/2(p  _  pi')c'/2  =  AiC/iY/  +  . . .  +  XsUsVl 

giving  the  coordinates  for  the  column  profiles  in 

AiF/C-’/2 


(4.3) 


(4.4) 


(4.5) 


Implicit  in  this  analysis  is  the  choice  of  measure  of  affinity  between  the  i-th  and  j-th  profiles 
as  the  squared  distance 


(Pi|.  -Pi|jf  ^  (P.l, 

Pi  ’ "  Ps 


(4.6) 
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which  is  the  chisquaxe  distance.  The  squared  Euclidean  distance  between  the  points  rep¬ 
resenting  the  i-th  and  j-th  profiles  in  the  reduced  space,  is  an  approximation  to  (4.6). 
Thus  the  clusters  we  see  in  the  Euclidean  representation  is  based  on  the  affinities  measured 
by  the  chisquare  distance  (4.6). 

An  alternative  to  the  chisquare  distance  which  has  some  advantages  is  the  Hellinger 
Distance  (HD)  between  the  i-th  and  j-th  column  profiles  defined  by 


+  ^  ^  ■  +  iy/P^i  -  ^/P7\jf  (4.7) 

which  depends  only  on  the  i-th  and  j-th  column  profiles.  In  such  a  case,  the  Euclidean 
distance  in  the  reduced  space  between  the  i-th  and  j-th  column  profiles  is  an  approximation 
to  (4.7).  For  the  derivation  of  canonical  coordinates  of  the  column  profiles  (considered  as 
population)  we  choose 

y/P\\l  •  •  •  y/Pl  |m 

y/Psll  •  •  •  \/Ps\m 

M  —  I,  W  =  C  =  Diag  (n.i/n, . . .  ,  n_mln) 

and  consider  the  s.v.d. 

{X  -  ei')C'/2  =  A, v;  +  . . .  +  X,UX-  (4.8) 

We  may  choose  =  (^i , . . .  ,  ^a)  with 

6'  =  y/Fi  =  y/ni./n,  or  (4.9) 

=  «"*(«. i\/1hir+ ••• +  (4.10) 

The  canonical  coordinates  in  for  the  column  profiles  choosing  ^  as  in  (4.9)  or  (4.10)  are 


/AiF/C-i/^ 


It  can  be  shown  that  the  statistic 


4n(Aj  -b  . . .  -t-  A^) 


(4.11) 


(4.12) 


is  asymptotically  distributed  as  chisquare  on  (s  —  l)(m  —  1)  degrees  of  freedom  to  test  for 
independence  in  the  two  way  contingency  table. 

The  advantages  in  using  Hellinger  distance  between  profiles  are  the  following. 
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1.  The  measure  depends  only  on  the  profiles  of  the  concerned  pair.  It  is  not  altered  when 
an  extended  set  of  profiles  is  considered. 

2.  The  measure  does  not  depend  on  the  sample  sizes  on  which  the  profiles  are  estimated. 

3.  The  choice  of  ^  as  in  (4.10)  provides  a  better  approximation  of  the  distances  in  the 
reduced  space.  However,  if  a  representation  of  the  row  profiles  is  also  needed  we  take  X  as 
the  matrix  of  the  square  roots  of  the  elements  in  Q' ,  where  Q  is  the  matrix  defined  in  (4.2) 
and  compute  the  s.v.d.  of 

(Q'  -  =  /iUiB;  +  . . .  +  timAmB[„ 

leading  to  the  canonical  coordinates  for  row  profiles 


(4.13) 


4.  If  we  choose  ^  as  in  (4.9),  then 

{X  -  =  (4/^  - 

V  n  \  n  n 

which  is  symmetric  in  i  and  j.  Then,  the  same  s.v.d.  as  in  (4.8)  could  be  used  for  computing 
the  canonical  coordinates 

\XkUiR-^/^ 

for  the  row  profiles,  as  in  the  case  of  CA. 

5.  AN  EXAMPLE 

We  consider  the  data  (from  Greenacre  (1993b))  on  796  scientific  researchers  classified 
according  to  their  scientific  discipline  (as  populations)  and  funding  category  (as  variables) 
as  shown  in  Table  3. 

Table  3.  Scientific  disciplines  by  research 
funding  categories 

Funding  category 

Scientific  discipline  a  b  c  d  e  Total 

Geology  G  3  19  39  14  10  85 
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Biochemistry 

1 

2 

13 

1 

12 

29 

Chemistry 

C 

6 

25 

49 

21 

29 

130 

Zoology 

Z 

3 

15 

41 

35 

26 

120 

Physics 

P 

10 

22 

47 

9 

26 

114 

Engineering 

E 

3 

11 

25 

15 

34 

88 

Microbiology 

Ml 

1 

6 

14 

5 

11 

37 

Botany 

B2 

0 

12 

34 

17 

23 

86 

Statistics 

S 

2 

5 

11 

4 

7 

29 

Mathematics 

M2 

2 

11 

37 

8 

20 

78 

Total 

31 

128 

310 

129 

198 

796 

The  canonical  coordinates  for  the  first  three  dimensions  and  percentage  of  variance  ex¬ 
plained  by  each  are  given  in  Table  4  for  the  analyses  based  on  the  chisquare  distance  (cor¬ 
respondence  analysis)  and  the  Hellinger  distance  (alternative).  The  formulas  (4.3)-(4.5)  are 
used  for  the  analysis  based  on  chisquare  and  the  formulas  (4.8)-(4.11)  for  that  based  on 
Hellinger  distance. 

Table  4.  Canonical  coordinates  for  the  scientific 
disciplines  in  the  first  three  dimensions 


Subjects  Chisquare  Distance  Hellinger  distance 


Diml 

Dim2 

Dim3 

Diml 

Dim2 

Dim3 

G 

.076401 

.302569 

-.087749 

-.031140 

.167408 

-.048245 

B1 

.179892 

-.454996 

-.151716 

-.129374 

-.242174 

-.077614 

C 

.037644 

.073353 

.042371 

-.021144 

.040433 

.028254 

Z 

-.327365 

.102283 

.064515 

.138850 

.045255 

.056894 

P 

.315552 

.026997 

.108688 

-.165340 

.010679 

.023844 

E 

-.117495 

-.291712 

.107330 

.049451 

-.129906 

.082901 

Ml 

.012766 

-.109656 

-.041435 

-.004913 

-.052588 

-.008439 

B2 

-.178695 

-.038501 

-.129055 

.151404 

-.036559 

-.108025 

S 

.124638 

.014162 

.107190 

-.066639 

.011763 

.052571 

M2 

.106751 

-.061316 

-.175688 

-.050307 

-.037572 

-.078006 

%  var. 

47.20 

36.66 

13.11 

45.87 

34.10 

16.57 

The  plots  of  the  scientific  disciplines  (subjects)  using  the  canonical  coordinates  based 
on  the  chisquare  and  Hellinger  distances  are  given  in  Figures  1  and  2  respectively.  The 
coordinates  in  the  third  dimension  axe  plotted  on  a  line  on  the  right  hand  side  of  the  two 
dimensional  plot.  This  will  be  of  help  in  visualizing  the  plot  in  three  dimensions  and  in 
interpreting  the  distances  in  the  two  dimensional  plot.  Thus,  although  B2  and  E  appear 
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to  be  close  to  each  other  in  the  two  dimensional  chart,  they  are  clearly  separated  in  the 
third  dimension.  No  additional  distances  in  the  third  dimension  are  involved  in  the  case  of 
P,  C,  5,  Z  and  E.  [It  may  be  noted  that  the  squared  distance  between  any  two  points  in  the 
three  dimensional  plot  is  equal  to  the  sum  of  the  squared  distances  in  the  two  dimensional 
plot  and  in  the  third  dimension]. 


[Here  Figures  1  and  2] 

It  is  of  interest  to  note  in  this  example  that  the  configuration  of  the  scientific  disciplines  in 
three  dimensions  obtained  by  both  the  methods  are  very  similar.  The  percentage  variance 
explained  in  each  dimension  is  nearly  the  same  for  both  the  methods. 

The  canonical  coordinates  for  the  variables  (funding  categories)  are  computed  using  the 
formuleis  (3.9)-(3.10).  These  are  obtained  from  the  same  s.v.d.  used  to  compute  the  canon¬ 
ical  coordinates  for  the  scientific  disciplines.  Table  5  gives  the  standardized  canonical  co¬ 
ordinates  for  the  funding  categories,  a,  b,  c,  d,  e,  using  the  formula  (3.10)  for  the  analyses 
based  on  the  chisquare  and  Hellinger  distances. 

Table  5.  Standardized  canonical  coordinates  for  funding 
categories  (variables)  in  the  first  three  dimensions 

Funding  Chisquare  Distance  Hellinger  Distance 

category 


diml 

dim2  dim3 

%var 

diml 

dim2 

dim3 

%var 

a 

.758 

.114  -.619 

97.1 

-.796 

-.164 

-.573 

98.9 

b 

.535 

.728  -.137 

83.5 

-.438 

-.766 

-.008 

77.9 

c 

.583 

.352  .694 

94.6 

-.501 

-.327 

.759 

93.4 

d 

-.426 

.331  -.172 

99.8 

.888 

-.358 

-.285 

99.7 

e 

-.108 

-.909  -.081 

99.6 

.088 

.978 

-.159 

98.9 

The  standardized  canonical  coordinates  for  the  funding  categories  are  plotted  in  Figure  3 
(for  chisquare  distance)  and  in  Figure  4  (for  Hellinger  distance).  It  may  be  noted  that  all  the 
points  lie  within  the  unit  circle.  It  is  customary  to  represent  the  canonical  coordinates  for 
the  subjects  and  variables  in  one  chart.  We  are  using  separate  charts  in  order  to  explain  the 
salient  features  of  the  configuration  of  the  variables.  The  following  interpretations  emerge 
from  the  study  of  Table  5  and  Figures  3  and  4. 

[Here  Figures  3  and  4] 

1.  The  configurations  of  the  funding  categories  as  exhibited  by  Figures  3  and  4  obtained 
by  using  chisquare  and  Hellinger  distances  are  very  similar. 
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2.  All  most  all  the  variation  in  the  funding  categories  a,  d  and  e  is  captured  in  the  first 
three  canonical  coordinates  of  the  scientific  disciplines.  A  large  percentage  of  variation  in  b 
and  c  is  explained  by  the  first  three  coordinates. 

3.  The  first  dimension  is  strongly  influenced  by  a  and  d,  the  second  dimension  by  6  and 
e,  and  the  third  dimension  by  a  and  c. 

Thus  the  use  of  standardized  coordinates  for  variables  enables  us  to  interpret  the  different 
dimensions  in  terms  of  observed  variables.  There  are  other  ways  of  plotting  the  coordinates 
of  the  variables  as  mentioned  in  the  paragraphs  below  Table  3.2.  Such  biplots  having 
a  different  interpretation  are  discussed  in  Gabriel  (1971),  Gifi  (1990),  Gower  (1993)  and 
Greenacre  (1993a). 


6.  CONCLUSION 

A  general  theory  is  developed  for  representing  high  dimensional  “population  by  variable” 
data  in  a  low  dimensional  Euclidean  space.  The  first  step  in  the  problem  is  the  specification 
of  the  basic  space  in  which  the  populations  can  be  considered  as  points  and  the  choice  of  a 
distance  measure  between  points  characterizing  the  differences  between  populations,  which 
in  a  practical  problem  depends  on  the  nature  of  the  investigation  involved.  The  second  step 
is  the  transformation  of  the  points  (representing  the  populations)  from  the  basic  space  to  a 
low  dimensional  Euclidean  space.  This  has  to  be  done  in  such  a  way  that  the  configurations 
of  the  points  as  defined  by  the  specified  distances  in  the  basic  space  and  the  Euclidean 
distances  in  the  reduced  space  are  as  similar  as  possible.  A  closed  form  solution  is  obtained 
when  the  basic  space  is  a  vector  space  endowed  with  an  inner  product  and  the  associated 
norm. 

When  we  have  data  in  the  form  of  a  two  way  contingency  table  with  the  frequency  in 
the  (z,  j)-th  cell  representing  the  number  of  individuals  from  population  j  having  category 
i  of  an  attribute,  a  well  known  method  for  representing  the  populations  in  a  low  dimen¬ 
sional  Euclidean  space  is  correspondence  analysis.  The  basic  space  in  this  case  is  a  vector 
space  where  each  population  is  represented  by  the  vector  of  relative  frequencies  of  the  dif¬ 
ferent  categories  of  an  attribute  and  distance  between  vectors  is  defined  by  a  chisquare  type 
formtda.  Such  a  distance  function  is  not  an  intrinsic  measme  of  difference  between  two 
populations  as  it  depends  not  only  on  the  differences  between  their  relative  frequencies,  but 
also  on  the  average  relative  frequencies  computed  from  the  set  of  populations  under  study. 
Thus  the  configuration  of  any  subset  of  populations  depends  on  what  other  populations 
are  included  in  the  analysis,  and  also  on  the  relative  numbers  of  individuals  observed  from 
each  population.  An  alternative  approach  of  representing  a  population  by  the  vector  of  the 
square  roots  of  relative  frequencies  and  defining  distance  between  two  populations  by  the 
Hellinger  formula  does  not  have  the  drawbacks  associated  with  the  chisquare  type  formula. 
In  addition,  the  new  analysis  has  the  same  advantage  of  providing  tests  of  significance  for 
homogeneity  (or  dimensionality)  of  the  populations  as  in  correspondence  analysis  based  on 
the  chisquare  formula.  Thus  the  method  of  dimensionality  reduction  based  on  Hellinger 
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distance  appears  to  be  a  better  tool  than  that  on  the  chisquare  distance  in  exploratory  data 
analysis. 

A  method  of  biplots  which  enables  an  interpretation  of  different  dimensions  in  the  reduced 
Euclidean  space  in  terms  of  the  original  variables  is  discussed  and  illustrated  through  an 
example. 

The  research  for  this  paper  is  supported  by  the  Army  Research  Office  under  Grant 
DAAH04-96-1-0082. 
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Figure  1 .  Configuration  of  scientific  disciplines 
using  Chisquare  distance 
(Correspondence  Analysis) 
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Figure  2  Configuration  of  scientific  disciplines 
using  Hellinger  distance 
(Alternative  to  Correspondence  Analysis) 
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F igure  3 .  Configuration  of  funding  categories  using 
standardized  canonical  coordinates  beised 
on  Chisquare  distance 
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Figure  A  .  Configuration  of  funding  categories  using 
sidiidardized  canonical  coordinates  based 
on  Hellinger  distance 
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